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How to Install and Configure ‘Collectd 


and ‘Collectd-Web’ to Monitor Server 
Resources in Linux 





Collectd-web is a web front-end monitoring tool based on RRDtool (Round-Robin Database 
Tool), which interprets and graphical outputs the data collected by the Collectd service on 
Linux systems. 


Collectd service comes by default with a huge collection of available plug-ins into its default 
configuration file, some of them being, by default, already activated once you have installed 
the software package. 


Collectd-web CGI scripts which interprets and generates the graphical html page statistics can 
be simply executed by the Apache CGI gateway with minimal of configurations required on 
Apache web server side. 


However, the graphical web interface with the generated statistics can, also, be executed by the 
standalone web server offered by Python CGIHTTPServer script that comes pre-installed 
with the main Git repository. 


This tutorial will cover the installation process of Collectd service and Collectd-web interface 
on RHEL/CentOS/Fedora and Ubuntu/Debian based systems with the minimal 
configurations needed to be done in order to run the services and to enable a Collectd service 
plug-in. 


Please go through the following articles of collectd series. 


Part 1: Install and Configure ‘Collectd’ and ‘Collectd-Web’ to Monitor Linux Resources 
Part 2: Monitor Linux Resources with Collectd-web and Apache CGI 


Part 3: Configure Collectd as a Central Monitoring Server for Clients 
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Step 1: — Install Collectd Service B) 


1. Basically, the Collectd daemon task is to gather and store data statistics on the 
system that it runs on. The Collectd package can be downloaded and installed from the default 
Debian based distribution repositories by issuing the following command: 


# apt-get install collecta [On Debian based Systems] 





Install Collectd on Debian/Ubuntu 


On older RedHat based systems like CentOS/Fedora, you first need to enable epel repository 
under your system, then you can able to install collectd package from the epel repository. 


# yum install collectd 


On latest version of RHEL/CentOS 7.x, you can install and enable epel repository from default 
yum repos as shown below. 


# yum install epel-release 
# yum install collectd 
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Loading mirror speeds from cached hostfile 
» base: centosmirror .gothosting.in 
» epel: ftp. jaist.ac. jp 
* extras: centosmirror .gothosting. in 
» updates: centosmirror .go¢hosting.in 
Resolving Dependencies 
| >» Running transaction check 
| > Package collectd.x686_64 6:5.4.2-1.e17 will be installed 
Finished Dependency Resolution Enabled Epel Repo 


Dependencies Resolved 


Package Arch Version 


Iransaction Summary 
| 


Instal | 1 Package 


Total download size: 500 k 
Installed size: 1.6 M l 
Is this ok [yrzd-7N]: http://www.tecmint.com 





Install Collectd on CentOS/RHEL/Fedora 


For Fedora users, no need to enable any third party repositories, simple yum to get the 
collectd package from default yum repositories. 


2. Once the package is installed on your system, run the below command in order to start the 
service. 


+ Service collectd start [On Debian based Systems] 
t Service collectd start [On RHEL/CentOS 6.x/5.x Systems] 
# systemctl start collectd.service [On RHEL/CentOS 7.x Systems] 


Step 2: Install Collectd-Web and Dependencies 


3. Before starting to import the Collectd-web Git repository, first you need to assure that Git 
software package and the following required dependencies are installed on your machine: 


E e On Debian: / Ubuntu systems =e - sees 


# apt-get install git 
# apt-get install librrds-perl libjson-perl libhtml-parser-perl 
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http:/iwww.tecmint.com 





Install Git on Debian/Ubuntu 


Sac CUR IS os Ca On RedHat/CentOS/Fedora based systems ----------------- 
# yum install git 
# yum install rrdtool rrdtool-devel rrdtool-perl perl-HTML-Parser perl—-JSON 
[root@tecmint ~J]# yum install git rrdtool rrdtool-devel rrdtool-perl perl-HTML-P| 
arser per!-JSUN | 
,oaded plugins: fastestmirror 

Gading mirror speeds from cached hostfile 

+ base: centosmirror.gothosting.in 

» epel: ftp.cuhk.edu.hk 

» extras: centosmirror.godhosting.in 

* updates: centosmirror.gothosting.in 
Package git-1.6.3.1-4.el?.xtb_64 already installed and latest version 
Package rrdtool-1.4.6-8.el?.xt6_64 already installed and latest version 
Package rrdatool-devel-1.4.6-8.el?¢.xtb_64 already installed and latest version 
*ackage rrdtool-per!]-1.4.6-68.e1?.x86_64 already installed and latest version 
'ackage perl-HIMNL-Parser-3.?71-4.el?¢.xtb_b4 already installed and latest version 


r 
| 


Package perl-JSON-2.59-2.el?.noarch already installed and latest version 
Nothing to do 
[root@tecmint ~]8 
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Step 3: Import Collectd-Web Git Repository and Modity 
Standalone Python Server 


4. On the next step choose and change the directory to a system path from the Linux tree 
hierarchy where you want to import the Git project (you can use /usr/local/ path), then run 
the following command to clone Collectd-web git repository: 


# cd /usr/local/ 

# git clone https://github.com/httpdss/collectd-web.git 

[root@tecmint locallt 

Lroot#tecmint localit cd /usr/local/ 

Lroot@tccmint localJ# git clone https:/7/qithub.comhttpdss/collectd-web.git 
Cloning into *collectd-web’... 

remote: Counting objects: 14380, done. 

receiving objects: bcz (6067/1436), 946.01 Kib i 4.600 KibB/s 


remote: Total 14380 (delta B), reused O (delta B), pack-reused 1438 
Receiving objects: 166% (1438/1430), 1.1? MiB i 23.08 KiB/s, done. 
Resolving deltas: 188% (666/666), done. 

Lroot#tecmint localit 

[rootütecmint local ]g 

froot@tecmint locallt _ 





Git Clone Collectd-Web 


5. Once the Git repository is imported into your system, go ahead and enter the collectd-web 
directory and list its contents in order to identify the Python server script (runserver.py), 
which will be modified on the next step. Also, add execution permissions to the following CGI 
script: graphdefs.cgi. 


# cd collectd-web/ 
# 1s 
# chmod +x cgi-bin/graphdefs.cgi 
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troot@tecmint local] cd collectd-web/ 

Lroot#tecmint collectd-webJ]# Is 

AUTHORS CHANGELOG COPYING index.html =c | 

cgi-bin docs iphone README .rst 
[root@tecmint collectd-web]# chmod +x cgi-bin/graphdefs.cgi 
l root@tecmint collectd-weblt _ 





Set Execute Permission 


6. Collectd-web standalone Python server script 1s configured by default to run and bind only 
on loopback address (127.0.0.1). 


In order to access Collectd-web interface from a remote browser, you need to edit the 
runserver.py script and change the 127.0.1.1 IP Address to 0.0.0.0, in order to bind on all 
network interfaces IP Addresses. 


If you want to bind only on a specific interface, then use that interface IP Address (not advised 
to use this option in case your network interface Address is dynamically allocated by a DHCP 


server). Use the below screenshot as an excerpt on how the final runserver.py script should 
look like: 


# nano runserver.py 
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File: /usr/ioccal/collectd-web/ runserver.py Me 


5 = = 


[ Wrote 24 lines } 


Pee Eo EA Ee Eee ee 





Configure Collect-web 
If you want to use another network port than 8888, modify the PORT variable value. 


Step 4: Run Python CGI Standalone Server and Browse Collectd- 
web Interface 


7. After you have modified the standalone Python server script IP Address binding, go ahead 
and start the server in background by issuing the following command: 


# ./runserver.py & 


Optional, as an alternate method you can call the Python interpreter to start the server: 


# python runserver.py & 
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iroot@tecmint collectd-webI]® ./runserver.py 4 

[1] 11319 

Lroot@tecmint collectd-webJ]# Collectd-web server running at http:771é2?7.6.8.1:8886 
iF 








Start Collect-Web Server 


8. To visit Collectd-web interface and display statistics about your host, open a browser and 
point the URL at your server IP Address and port 8888 using HTTP protocol. 


By default you will see a number of graphics about CPU, disk usage, network traffic, RAM, 
processes and other system resources by clicking on the hostname displayed on Hosts form. 


net Ot / 192 woe. a Llion 


Wen 


Hosts server.example.lan 


erywer 2 rane lē. Lān/ menory 


Available Plugins 





r | pe 
=| freee I.S Pe |. fi. Avg Ll. Mar | = Leg 
B cached 1a. dh Mae 14l. EH Avg 145. dh Mou 145, a6 Lagt 
Bo F fered 2.24 Mir “40M Aw à I7. TH Har 17. 7A Lest 
E used J705. 7H Mii 722. 7H Avg 737.60 Mar 733. BH Lart 


Access Collect-Web Panel 
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C@ [> 192.168.1.211:88se 


Er ery | = 
interface Gm-0/disk_octets Mer 











irg 
Load 400 k 
menory ~ 300 k 
Ņ 
processes É 200% 
wap 
l 100 k y 
Ser LSA B a 
o : i t 2 ? : 7 dnt, = 
20:10 20: 20 20: 30 20:40 20: 50 71:00 
E written 168.6 Avg, 495.6 Mar, 238.0 Last (ca. 544. 4HB Total) 
B cead 4.7% Avg, 397.7 Man, 0.0 Last ica. 15.546 Total) 
dm-0/disk_ops 
100 f 
80 
| 
Ei 
& 
L J EA iff E E Sery 4 
20:10 20:20 20: 30 
B Written 35.73 Avg. 101.95 Mar, 49.25 Last 
B Read 0.20 Avg, 15.05 Man, 0.00 Last 


Gm-0/disk_time 


O [0 n0 wnr frora foina 


Linux Disk Monitoring 





9. To stop the standalone Python server issue the below command or you may cancel or stop 
the script by hitting Ctrl+c key: 


# killall python 


Step 5: Create a Custom Bash Script to Manage the Standalone 
Python Server 


10. To manage the standalone PyhtonCGIServer script more easily (start, stop and view 
status), create the following collectd-server Bash script at a system executable path with 
the following configurations: 


# nano /usr/local/bin/collectd-server 


Add the following excerpt to collectd-server file. 


tt / poi n/ bash 


PORT="8888" 
case $1 in 
start) 


cd /usr/local/collectd-web/ 

python runserver.py 2> /tmp/collectd.log & 

sleep 1 

stat= netstat -tlpn 2>/dev/null | grep SPORT | grep "python"| cut -d":" =f2 
| Cae. =d" m =f 
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sock="netstat -tlpn 2>/dev/null | grep SPORT | grep "python" 
echo -e "Server ig still running: \nosock” 
else 
echo -e "Server has stopped" 
[i 
stop) 
pid= ps =x | grep “python runserver.py”" | grep -v "color": 
kill =9 Spid 2>/dev/null 
stat= netstat -tlpn 2>/dev/null | grep SPORT | grep "python"| cut -d":" =f2 
| gut =d" T sf 
if [[ SPORT -eq Sstat ]]; then 
sock="netstat -tlpn 2>/dev/null | grep SPORT | grep "python" 
echo: =e “Server is still running: \nosock” 
else 
echo -e "Server has stopped" 
fi 
status) 
Stat= netstat. -Cilon 2Z>/dev/null |oqrép SPORT] grep “oython” | cut -—d"s" =—£2 | 
cul =d m =f 
if [[ SPORT -eq Sstat ]]; then 


sock="netstat -tlpn 2>/dev/null | grep SPORT | grep "python" 
echo =e "Server is running: \nosock” 

else 

echo -e "Server is stopped" 

fi 

rr 

*) 

echo "Use SO start|/stop/status" 

ry 


esac 


In case you have changed PORT variable number from runserver.py script, make sure you 
make the port variable changes on this bash file accordingly. 


11. Once you have created the collectd-server script, add executing permissions in order to be 
able to run it. The only thing remaining now is to manage the Collectd-web server in a similar 
way as you do with a system service by issuing the following commands. 


chmod +x /usr/local/bin/collectd-server 
collectd-server start 

collectd-server status 

collectd-server stop 


+= SF SF OSE 
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[root@tecmint collectd-web1]# chmod +x /usr/local/bin/col lectd-server 
troot#tecmint collectd-webJ# collectd-server start 
l still running: 

H A 127.80.80.1:886886 H.H.H.H: 
OE TA: Palla@iel) 
troot#tecmint collectd-webl]# collectd-server status 

running: 

H A 127.80.0.1:8686 4.4.0.0: 
11426/python 
lroot@tecmint collectd-webJ# collectd-server stop 
server has stopped 
[root@tecmint collectd-webJ]# collectd-server status 


Server is stopped 
[root@tecmint col lectd-web]# 


Collectd Server Script 


Step 6: Enable a Collectd Daemon Plug-in 
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12. In order to activate a plug-in on Collectd service, you must go to its main configuration file, 
which is located at /etc/collectd/collectd.conf file, open this file for editing and 
uncomment, the first time (remove the # sign in front) the plug-in name you want to activate. 


Once the LoadPlugin statement with the name of the plug-in has been uncommented you must 
deeply search through the file and locate the same plugin name which holds the configurations 


required to run. 


As an example, here’s how you active Collectd Apache plugin. First open Collectd main 


configuration file for editing: 


# nano /etc/collectd/collectd.conf 


A. Use Ctrl+w to enable nano editor search and type apache on below terminal the search 
filed. Once LoadPlugin apache statement has been found, remove the comment special sign # 


to uncomment it, as illustrated in the below screenshot. 
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r r alg E W j _@-F r ag ra Pag -y 
5 Ex is r ia W s Next htipziwwvitecmint.com 


Enable Collectd Apache Plugin 


B. Next, type Ctrl+w to search again, apache should already appear on search filed and press 
Enter key to find the plug-in configurations. 


Once apache plug-in configurations are located (they look similar to Apache web server 
statements) uncomment the following lines, so that the final configuration should resemble to 
this: 


<Plugin apache> 

<Instance “example.lan"> 

URL "http://localhost/server-status?auto" 
User "www-user" 
Password "secret" 
VerifyPeer false 
VerifyHost false 
CACert "/etc/ssl/ca.crt" 
Server "apache" 

/Instance> 


<Instance "bar"> 
URL "http://some.domain.tld/status?auto" 
Host "some.domain.tld" 
Server "lighttpd" 
</ Instance — 
/Plugin> 


A HE SE He SE HE SE A HE OSE HE SHE HE 


Elies Jebri Page 12 sur 15 


Collectd on Linux Servers > ; 


Opt20pen 


Promoting you in Open Source 





GNU nano 2.2.6 File: /etc/collectd/collectd.conf 


http://www.tecmint.com 





Enable Apache Configuration for Collectd 


Note: Replace <Instance "example.lan"> statement string according to your server 
hostname. 


C. After you finish editing the file, save it (Ctrl+o) and close it (Ctrl+x), then restart Collectd 
daemon to apply changes. Clear your browser cache and reload the page to view the statistics 
collected by Collectd daemon so far for Apache Web Server. 


# /usr/local/bin/collectd-server start 


Cc 192.168.1 6 = 


Collectd-web Menu 
Hosts Cserver.example.tan 


E its 3.0 Min 9.1 Arg 2.0 Moe 79.6 Last ca. 272.76 Total 





Apache Monitoring 
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To enable other plug-ins please visit Collectd Wiki page. Promoting you in Open Source 





Step 7: Enable Collectd Daemon and Collectd-web Server 
System-Wide 
13. In order to automatically start Collectd-web server from the Bash script at boot time, open 


/etc/rc.local file for editing and add the following line before the exit 0 statement: 


Jusr7 locals bin/collecta—server start 
GNU nano 2.2.6 File: /etc/rc.local 





http~/www.tecmint.com 


Enable Collectd Systemwide 


If you’re not using the collectd-server Bash script which manages the Python server script, 
replace the above line on re.conf with the following line: 


# cd /usr/local/collectd-web/ && python runserver.py 2> /tmp/collectd.log & 


Then, enable both system services by issuing the following commands: 


a ae ate cle Om Debian / Ubuntu =29——=-444-4---=-— 
# update-re.d collectd enable 
# update-re.d rce.local enable 


Optionally, an alternate method to enable this services at boot time would be with the help on 
sysv-rc-conf package: 


O Cen an On Debian / Ubuntu ---—----~----------- 

# SySvV-rce-conr collectada on 

t sysv-rc-conf rc.local on 

Se E a On RHEL/CentOS 6..x/5.x and Fedora 12-19 --------------- 
# chkconfig collectd on 

# chkconfig --level 5 collectd on 

Se E On RHEL/CentOS 7.x and Fedora 20 onwards --------------- 
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That’s all! Collectd daemon and Collectd-web server prove to be excellent 
monitoring tools for Linux servers, with minimal impact concerning system resources, which 
can generate and display some interesting graphical statistics about machines workload, the 
only drawback so far being the fact the statistics are not displaying in real time without 
refreshing the browser. 
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